A Multi-Agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learning
نویسندگان
چکیده
Federated learning (FL) is a training technique that enables client devices to jointly learn shared model by aggregating locally computed models without exposing their raw data. While most of the existing work focuses on improving FL accuracy, in this paper, we focus efficiency, which often hurdle for adopting real world applications. Specifically, design an efficient framework optimizes processing latency and communication all are primary considerations implementation FL. Inspired recent success Multi Agent Reinforcement Learning (MARL) solving complex control problems, present FedMarl, federated relies trained MARL agents perform run-time selection. Experiments show FedMarl can significantly improve accuracy with much lower cost.
منابع مشابه
Federated Control with Hierarchical Multi-Agent Deep Reinforcement Learning
We present a framework combining hierarchical and multi-agent deep reinforcement learning approaches to solve coordination problems among a multitude of agents using a semi-decentralized model. The framework extends the multi-agent learning setup by introducing a meta-controller that guides the communication between agent pairs, enabling agents to focus on communicating with only one other agen...
متن کاملMulti-Agent Reinforcement Learning
This thesis presents a novel approach to provide adaptive mechanisms to detect and categorise Flooding-Base DoS (FBDoS) and Flooding-Base DDoS (FBDDoS) attacks. These attacks are generally based on a flood of packets with the intention of overfilling key resources of the target, and today the attacks have the capability to disrupt networks of almost any size. To address this problem we propose ...
متن کاملLearning Automata as a Basis for Multi Agent Reinforcement Learning
Learning Automata (LA) are adaptive decision making devices suited for operation in unknown environments [12]. Originally they were developed in the area of mathematical psychology and used for modeling observed behavior. In its current form, LA are closely related to Reinforcement Learning (RL) approaches and most popular in the area of engineering. LA combine fast and accurate convergence wit...
متن کاملMulti-Agent Deep Reinforcement Learning
This work introduces a novel approach for solving reinforcement learning problems in multi-agent settings. We propose a state reformulation of multi-agent problems in R that allows the system state to be represented in an image-like fashion. We then apply deep reinforcement learning techniques with a convolution neural network as the Q-value function approximator to learn distributed multi-agen...
متن کاملMulti-agent Relational Reinforcement Learning
In this paper we study Relational Reinforcement Learning in a multi-agent setting. There is growing evidence in the Reinforcement Learning research community that a relational representation of the state space has many benefits over a propositional one. Complex tasks as planning or information retrieval on the web can be represented more naturally in relational form. Yet, this relational struct...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2022
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v36i8.20894